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Abstract 

We use real replicas within the Thouless, Anderson and Palmer construction to investigate stabil- 
ity of solutions with respect to uniform scalings in the phase space of the Sherrington-Kirkpatrick 
model. We show that the demand of homogeneity of thermodynamic potentials leads in a natural 
way to a thermodynamically dependent ultrametric hierarchy of order parameters. The derived hi- 
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erarchical mean-field equations appear equivalent to the discrete Parisi RSB scheme. The number 
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of hierarchical levels in the construction is fixed by the global thermodynamic homogeneity ex- 
pressed as generalized de Almeida Thouless conditions. A physical interpretation of a hierarchical 
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£> ■ structure of the order parameters is gained. 
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I. INTRODUCTION 

The mean-field model for spin glasses introduced by Sherrington and KirkpatrickQ] is 
a paragon for complex statistical systems. Although very simple in its formulation, the 
model offers almost inconceivable richness of the phase space of its solution(s). This rich- 
ness is manifested in the replica-symmetry breaking (RSB) solution introduced by G. Parisi 
within the replica trick. M Since then, a lot of supporting arguments reaching from numer- 

n n 

ical simulations |3j over analytic thermodynamic approaches without the replica trickfj] to 
rigorous mathematical constructions [5| have been accumulated in favor of accuracy and ex- 
actness of the Parisi RSB solution of the Sherrington-Kirkpatrick (SK) model. In spite of 
the amassed evidence indicating to the RSB character of the eventual solution of the SK 
model, we have not yet fully understood in physical terms the origin of the RSB ansatz with 
its ultrametric hierarchical structure of order parameters. 

The replica-symmetry-breaking solution of Parisi was proposed as a means for maximiza- 
tion of the averaged free energy as a functional of the averaged order parameters in the limit 
of zero number of mathematical replicas. Analytic continuation from integer to non-integer 
numbers of replicas less than one is, however, not trivial and unique. The maximum principle 
seems to provide a way how to single out a particular analytic continuation. Although the 
Parisi ansatz provides an internally consistent solution numerically reproducing the results 
from Monte-Carlo simulations,)^] it is not evident whether it leads to the absolute maximum 
of the free energy. Moreover, even when observed empirically on simpler solutions of the 
SK model that more stable solutions have higher averaged free energy, there is no general 
physical law from which we could derive the maximum principle for the averaged free energy. 
On the other hand, a supremum from all possible choices of the Parisi order parameters q(x), 
x G [0, 1] was proved to lead to an exact averaged free energy of the SK model. Q| The RSB 
scheme hence has a deeper meaning and there must be a fundamental physical principle from 
which one could derive the RSB solution without additional physically unjustified ansatzes. 

The aim of this paper is to demonstrate that the maximum principle in the Parisi solution 
can be replaced by minimization of inhomogeneity of thermodynamic potentials in a suc- 
cessive way toward a globally thermodynamically homogeneous solution. Thermodynamic 
homogeneity is a fundamental property needed for the existence of a unique thermodynamic 
limit of statistical systems. It is a consequence of scale invariance of the limit of volume 
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V of the system to infinity. That is, large volumes V and aV of thermodynamically ho- 
mogeneous systems must produce the same thermodynamics, i. e., the same densities of 
extensive thermodynamic variables. Only in thermodynamically homogeneous systems the 
thermodynamic limit does not depend on the shape and the boundary conditions of large 
finite volumes. 

We find it useful to apply specific scalings of extensive variables of mean-field, long-range 
models represented by replications of the phase space. We employ real replicas of the spin 
variables and demand that the thermodynamics in the replicated phase space be independent 
of the number of introduced equivalent replicas. The independence of the resulting averaged 
free energy density on the number of real replicas is investigated by studying stability of 
thermodynamic potentials with respect to perturbations induced by infinitesimal homoge- 
neous interactions between different replicas. Thermodynamic potentials are stable if linear 
response to the inter-particle interaction remains finite and the spin replicas decouple in the 
equilibrium state after switching off the external inter-replica interaction. 

The role of real replicas in this approach is similar to the role of mathematical replicas in 
the replica trick. They are used to represent integer powers of the partition sum. Unlike the 
replica trick the number of real replicas will not be limited to zero. Alike the replica trick we 
will need to continue analytically the averaged replicated free energy from integer numbers 
of real replicas to arbitrary positive numbers to test thermodynamic homogeneity locally. 
For this purpose we will need to assume a symmetry of the averaged replica-dependent 
order parameters, Legendre conjugates to the inter-replica interaction. To find a physical 
motivation for a selection of a particular symmetry, we use the thermodynamic approach 
of Thouless, Anderson and Palmer (TAP). In this approach we are endowed with a set of 
thermodynamic mean- field parameters, local magnetizations m 8 . They have to determine 
equilibrium thermodynamic states at fixed configurations of spin-spin couplings. If the full 
set rnj, i = 1, . . . , N determines the thermodynamic state uniquely, the replica symmetric 
ansatz applies as in the high-temperature phase. If not and the set of local magnetizations 
does not contain full information about equilibrium states, the system is thermodynamically 
inhomogeneous and further knowledge of the system is needed. We propose in this paper a 
systematic way how to retrieve the missing information about the structure of degenerate 
states described by a set of local magnetizations. Our construction leads in a rather direct 
way to an ultrametric structure of the order parameters in the (real) replica indices and to 
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a hierarchical averaged free energy equivalent to the discrete RSB solution of Parisi. 



II. THERMODYNAMIC HOMOGENEITY AND AVERAGING OF REPLI- 
CATED TAP FREE ENERGIES 

A. Thermodynamic homogeneity and replications of the phase space 

Homogeneity of thermodynamic potentials is one of basic principles of statistical 
mechanics. Thermodynamic homogeneity in systems with short-range interactions is 
usually expressed as the Euler condition for thermodynamic potentials (free energy) 
aF(T, V,N,..., Xi, . . .) = F(T, aV, aN, . . . , aXi, . . .), where a is an arbitrary positive num- 
ber and Xi exhaust all extensive variables. Only if the Euler homogeneity is fulfilled we are 
able to factorize the volume from extensive variables, come over to densities, and define the 
thermodynamic limit uniquely and independently of the shape and boundary conditions of 
finite volumes. Thermodynamic homogeneity can be rephrased as a scale invariance of en- 
tropy S(E) = ks^^{E) = ks/ ' v In T(E) V for arbitrary positive v. This definition extends 
also to mean-field (long-range) models. We hence use the latter form of thermodynamic 
homogeneity applied to the averaged free energy of the SK model. 

Assuming thermodynamic homogeneity we can write the averaged free energy as F = 
— l/f3v (in [Tr e - ^] ) . ^ ^ e scann S factor v is a positive integer we can equiva- 
lently represent the discrete multiplication of the phase space via replicating the dy- 
namical variables in the partition sum (folding of the phase space): [Tr exp{— /3H}] U = 
Tr^exp^Yl Yl<ij> JijS? Sj \- Each replicated spin variable Sf is treated independently, 
i. e., the trace operator Ty u operates on the z/-times replicated phase space. Calculation of 
the free energy in the expanded phase space amounts to evaluation of the free energy of the 
replicated Hamiltonian. This multiplication of the number of dynamical variables is called 



to illustrate the meaning of the overlap 
" loj | Note that replicating the phase 



real replicas and has been occasionally used, most 
order parameters in the Parisi RSB construction, 
variables z/-times is not the same operation in long-range models as a scaling of the volume 
V — > aV. The spin-spin couplings, that are in short-range models intensive variables, de- 
pend in long-range models on the volume as well and are to be scaled, in the SK model as 
Jij — > Jij/y/a, to compensate for additional couplings in the inflated volume. Replicating 
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of the phase space seems a more suitable and simpler tool for investigating thermodynamic 
homogeneity of mean-field models than direct scalings of the phase space with all new spins 
coupled to the old ones. When we replicate the original phase space we completely decouple 
the new replicated spins from the original ones and do not thereby change the normalization 
of the spin-spin couplings. Moreover, replication of phase variables is more suitable for in- 
vestigating stability with respect to perturbations induced by interactions between different 
replicas without breaking translational invariance. 

Real replicas are also of principal importance for the thermodynamic construction of 
a mean-field theory of spin glasses, since they offer a space for new symmetry-breaking 
fields. The real replicas are independent when introduced. We break their independence by 
switching on a (homogeneous) infinitesimal interaction between the replicas that we denote 
fi ab . We then add a small interacting part AH(fi) = £V J2a<b^ ab ^i^i *° the replicated spin 
Hamiltonian. The averaged free energy per replica of the system with weakly interacting 
replicas reads 



The inter-replica interactions /i > play the role of symmetry-breaking fields in the SK 
model. They induce new order parameters in the response of the system to this field that 
need not vanish in the low-temperature phase, when the linear response theory breaks down. 
They allow to disclose the degeneracy when mean-field solutions do not represent unique 
pure equilibrium states. The inter-replica interactions are unphysical (not measurable) and 
hence to restore the physical situation we have to switch off these fields at the end. If the 
system is homogeneous we must end up with an identity 



This quantification of thermodynamic homogeneity, thermodynamic independence of the 
scaling parameter v, will lead us in the construction of a stable solution of the SK model. 

B. Averaging of the replicated TAP free energy 

Thermodynamic homogeneity can be investigated in the SK model either in the replica 
trick or in the thermodynamic TAP approach. Thermodynamic homogeneity in the replica 
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trick is equivalent to scale invariance of the limit of the number of mathematical replicas 
to zero, i. e., the result should be invariant with respect to scalings of the replica index 
„ - M We prefer to use here the thermodynamic TAP approach 8 o that to demonstrate 
that the RSB scheme is neither part of the replica trick nor a consequence of the limit of the 
number of mathematical replicas to zero. We also find the TAP approach more appropriate 
for finding a physical interpretation of the role of the replicated spins. They are used to lift 
degeneracy in the determination of equilibrium thermodynamic states from the mean-field 
local magnetizations. 

The TAP free energy can suitably be represented as 



-i^ln2cosh[/3(/i + ^)] . (3) 

We introduced fluctuating internal magnetic fields rji as variational parameters making free 
energy (jHJ) together with the local magnetizations extremal. The stationarity equations 
for the internal magnetic fields and for the local magnetizations read rji = ^ . Jijirij — 
rrii ^ ■ fiJijiX — rrii = tanh[/3(/i + rji)}, respectively. We can now try to solve these TAP 
equations for mj,^ on finite lattices with fixed configurations of spin-spin couplings Jij. 
We are then confronted with a plethora of metastable solutions that are difficult to handle. 
Instead of individual solutions we can better deal with the so-called complexity of the TAP 
equations, being proportional to the total number of solutions, jl^ 

The existence of many metastable solutions of the TAP equations generally hinders direct 
averaging over the random configurations of the spin-spin couplings. If the direct method is 
used, that is if we remain within the linear response theory with the fluctuation-dissipation 

14 1 Mezard et aljl5| purposed the so- 
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theorem valid, we end up with the SK solution, 
called cavity method to include ensembles of statistically weighted TAP solutions into the 
averaging process and succeeded in going beyond the SK solution toward the Parisi RSB 
scheme. 

In this paper we want to avoid any special ansatzes about the structure or the distribution 
of the TAP solutions and to remain entirely within the direct averaging scheme with the 
ergodic and fluctuation-dissipation theorems obeyed. The fluctuation-dissipation theorem, 
expressed in the TAP construction as xu — (1 — m ?)/^\ strictly holds only if the individual 



TAP solutions determine unique thermodynamic states. It was shown by Plefka that this is 



the case if 1 > 3 2 (1— 2 (m?)„,, + (mf )„,,). jl6j| We, however, know that this condition is violated 
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in the low-temperature phase, which led Plefka to modifications of the TAP equations. 

We in principle follow an analogous way to Plefka and assume that local magnetizations 
determined from the TAP equations do not contain exhaustive information about the equi- 
librium thermodynamic states. We modify the TAP equations and connect violation of the 
Plefka condition with violation of thermodynamic homogeneity. We introduce real replicas 
into the TAP approach to substantiate this. We use the TAP free energy with v equivalent 
spin replicas on each site. Real replicas were introduced into the TAP approach from a 



different motivation by the author years ago. 18j The result, a generalized TAP free energy 
with v replicas with switched off inter-replica interactions, fi ab = 0, can then be overtaken 
from Ref. [3]. It reads 

a-1 



,ab m b 



f3J 2 N ^ 



a?n2 

{X 

6=1 



(4) 



a=l L i 

hJ hJ ) 

~ Tv % ln Tr exp { 02 j2 ^ + P E ^ + ^ s ? 

i \ a<6 a=l 

Here m° are local magnetizations and rfl are local internal magnetic fields. They are con- 
figurationally dependent variational variables determined from stationarity equations. Pa- 
rameters x at \ a 7^ b, are overlap susceptibilities and are global (translationally invariant) 
variational variables, Legendre conjugates to the symmetry breaking fields fi ab . They are 
the genuine order parameters in the spin glass phase of the SK model in this construction. 
At the saddle point we have X ab = N~ x £\ [(S?S b ) T - (S?) T (S!) T ] ■ 

Free energy F u from Eq. (j3J) is averaged over thermal fluctuations for one configuration 
of spin-spin couplings J{j. To perform averaging over the randomness in the spin-spin cou- 
plings we have to decide whether the solutions of the replicated TAP equations, stationarity 
equations derived from free energy (|IJ), determine unique equilibrium thermodynamic states 
or not. If not, we have to surmise the internal structure of equilibrium states represented 
by a set of local magnetizations and averaged overlap susceptibilities. It can be done only 
via an ansatz. The pure states in spin glasses are, however, peculiar in that respect that 
they cannot be singled out by external symmetry-breaking fields. To avoid application of 



any unjustified ansatzes, we assume that the solutions of the replicated TAP equations do 
represent unique thermodynamic states as it is the case in the high-temperature phase. It 
means that replication of the phase space serves as a replacement of symmetry breaking 
fields. Replicating the phase space enable us to extend the high-temperature properties, 
that is the replica symmetric ansatz, to low temperatures in analogy to the ferromagnet 
in an external magnetic field. Then the linear response, ergodic and fluctuation-dissipation 
theorems hold and we can use the same averaging of the replicated TAP free energy as used 
to derive the SK solution from the TAP free energy. 

Even with the assumption of uniqueness of equilibrium states in the replicated phase 
space the averaging of the replicated free energy (j3J) cannot be performed explicitly. We 
first have to quantify thermodynamic equivalence of the replicated spin variables. Since the 
replicated spin variables were introduced in the TAP approach to deal with a possible degen- 
eracy of solutions of the TAP equations properly, we assume the following thermodynamic 
equivalence of real replicas motivated by the paramagnetic solution 



There is no apparent reason for breaking this equivalence in the spin glass phase, since 
each copy of the spin variables shares the same external macroscopic parameters deter- 
mining the thermodynamic state. Equation © expresses the fact that each TAP solution 
with local magnetizations represents on average v thermodynamic states labeled by the 
replica index a. The different thermodynamic states are indistinguishable at the level of 
local magnetizations. Since the replicated spin variables are distinct, their local overlap sus- 
ceptibility is not, however, determined from the fluctuation-dissipation theorem and enters 
the free energy as a variational parameter. Equivalence of spin replicas, Eq. (j3J), leads then 
to independence of local magnetic fields r)f and the sum of the averaged overlap suscepti- 
bilities YlbX ab °f t ne replica index a. With this conclusion we can write down an explicit 
representation of the averaged free energy density with v equivalent real replicas 



ml = {S?) T = m t . 



(5) 
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We denoted the fluctuating magnetic field h = h + rj^/q. The averaged order parameters are 
at the saddle point q = ((S a ) 2 T ) av and x ab = ((S a S b ) T ) av - q. 

The trace in the averaged free energy density © cannot be evaluated explicitly To do 
so we have to know the matrix of the overlap susceptibilities x ab reflecting the structure 
of thermodynamic states indistinguishable in the TAP equations. Mathematically it means 
to find the most general structure of matrix x ab with the constraint that YlbX ab does not 
depend on a. Since we do not know how such a structure should look like, we have to make 
a choice and check only a posteriori, whether our choice has led to a consistent solution. We 
use an iterative construction with successive replications of the phase space accompanied by 
the replica-symmetric ansatz for the overlap susceptibilities at each step. We replicate the 
system so many times until a thermodynamically homogeneous solution satisfying Eq. (J2J) 
is reached. 



C. Analytic continuation and local and global thermodynamic homogeneity 

The mean-field (saddle-point) equations for x ab derived from the averaged free energy 
density (jUJ) are identical for all pairs of the replica indices (ab), a ^ b. There is no apparent 
symmetry breaking force in the replica space and x ab = X is evidently a possible solution. 
We choose this simplest, replica symmetric solution so that we can evaluate the averaged 
free energy explicitly. This replica-symmetric choice corresponds physically to a situation 
where the TAP solutions comprise of equivalent distinguishable thermodynamic states with 
the same overlap susceptibility (distance) between each pair of different states. Hence no 
internal structure of equilibrium states is assumed. 

It is straightforward to evaluate the averaged free energy density f u with the ansatz 
X ab = X- We employ the Hubbard- Stratonovich transformation to decouple the replicated 
spins and end up with 

X) = ~ (1 - qf + 1)X(2? + X) + \x~ 

i /*oo /*oo 

-— / Vrjln T>X{2cosh[P(h + r} s /q + X y /xW (?) 

J — oo J — oo 

where we used an abbreviation for the Gaussian differential Vcf) = d<f) e~^l 2 / \^2n. We put 
J = 1 and use this energy scale throughout the rest of the paper. 
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The averaged free energy density, Eq. (J7J), however, apparently depends on v whenever the 
order parameter \ > 0. It is the case in the spin-glass phase below the de Almeida-Thouless 
(AT) instability line. Free energy (J7j) has the form identical with the Parisi one-step RSB 
solution, where v plays the role of the parameter dividing the replica space in the RSB 
ansatz.[2| We can easily analytically continue the r.h.s. of Eq. (|7J) to all real numbers. The 
integral representation in Eq. (J7|) is well defined and analytic for v £ (—00, 00). 

There are two observations we can make from the analysis of free energy (JJJ). First, at 
any value of v the overlap susceptibility is positive below the AT line. It indicates that the 
SK solution (x = 0) becomes thermodynamically inhomogeneous. Second, we are unable 
to find parameters q, x for which free energy (J7|) would be //-independent and hence the 
TAP solutions indeed do not describe unique thermodynamic states in the low-temperature 
phase. Our modification of the TAP free energy becomes nontrivial. 

Free energy (J7J) is not globally thermodynamically homogeneous, since it depends on the 
scaling parameter v. We can, however, optimize the solution in that we demand that the 
deviations from the thermodynamic homogeneity be minimal. This is achieved if at least 
thermodynamic homogeneity is obeyed locally, that is, if 

dJJ^d = Q (g) 
ov 

This equation determines an optimal parameter u opt for which the free energy is locally 
thermodynamically homogeneous. We show later on that Eq. (JHJ) has always a solution 
with u opt > 0. Free energy (J7J) together with the optimization condition (jHJ) exactly de- 
liver the thermodynamics of the Parisi one-step RSB. Monasson and later Mezard proposed 
111 Refs. Q a similar approach to the thermodynamics of structural glasses, the so 
called cloned liquid. The local homogeneity, Eq. (jHJ), was interpreted there as vanishing of 
complexity. 

Satisfying thermodynamic homogeneity locally for the optimal parameter u opt is generally 
insufficient. We in fact should construct a theory being globally thermodynamically homo- 
geneous. To check whether free energy (J7J) can for any v be globally thermodynamically 
homogeneous we have to perform a further scaling of extensive variables via replicating the 
spin variables in Eq. (JBJ). We do so by replacing v — > nv and testing homogeneity of the free 
energy f v with respect to the n-times enlarged (replicated) phase space. With the new scal- 
ing we have to replicate each spin variable S a to (S a ) a and transform the matrix of overlap 
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susceptibilities to a super matrix x ab (x al3 ) ab where a, b = 1, . . . , v and a, /3 = 1, . . . , n. 
With this replication we allow that the local spin variables S a may still be insufficient to 
determine unique thermodynamic states. Since all spin variables S a are thermodynamically 
equivalent, they have to split into new states labeled by the new replica index a identically. 

The mean-field equations for (x a ^) ab again contain a replica-symmetric solution xi = 
(x a ^) ab for a 7^ b and Xi = (x al3 ) aa f° r ot ^ f3. This symmetric solution assumes that the 
local TAP magnetization can be represented by v composite states each of which contains 
n pure states. Two pure states are distinguished by the overlap susceptibility Xi if they peel 
off from the same parental spin S a and by xi if they stem from two different parental spins 
S a , S b , a^b. 

It follows from the presented construction that Xi — X2- The free energy now generally 
depends on n, v and xi, Xi- We obtain explicitly 

fuAQ, Xu X2) = -j (1 - qf + I Xi + J [(f - l)Xi(2g + Xi) + v{n - l) Xa (2g + X2)} 
~ pL J Vr]ln J VXl J VX 2{^^sh[(3(h + r ] ^+X 1 VxT^x'2 + XVx^)]Y , (9) 

which again is equivalent to the Parisi 2RSB free energy. Free energy f u>n from Eq. (jHJ) is 
independent of n and reduces to f u from Eq. (J2J) if and only if X2 = 0. 

When this "second level" free energy f v>n depends on n it can be optimized so that it 
be locally thermodynamically homogeneous. The result can be subject to a further scaling 
of extensive variables in order to verify whether the resulting thermodynamic potential is 
globally homogeneous. We can proceed with the hierarchical (multiplicative) scalings ac- 
companied with the replica-symmetric ansatz about the structure of the newly generated 
overlap susceptibilities so long until the free energy becomes a thermodynamically homoge- 
neous function, i. e., the free energy does not depend on the last scaling parameter. It is 
evident that with each transformation we generate just one scaling parameter mi and one 
block-off-diagonal matrix of the overlap susceptibility xi- 
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III. HIERARCHICAL MEAN-FIELD THEORY 



A. Hierarchical free energy 



After performing K scaling transformations (replications of spin variables) we end up with 
K geometric parameters mi < 1712 < . . . < itlk = v as well as K overlap susceptibilities 
Xi > X2 > • • • Xk > characterizing the phase space of the order parameters. At each step 
(hierarchical level) of this construction we use the Hubbard-Stratonovich transformation to 
linearize the newly introduced (replicated) spin variables in free energy ©• If we define 
m = 1 and Xk+i — we can represent the averaged free energy density with K hierarchical 
scaling transformations in the following form 



K 



fi<{q, {x}; {«•>}) = -f (! - <?) 2 + 7 X^Oz - m-i)xi{^q + xi) + f x\ 



1=1 



1 



dr] -.e~^ 2 \n 



In 



00 



dX 



2 cosh 



00 V 27T 
K 



-00 



d\ 1 
, e 



Af/2 



-00 v27T 

mi \ m K l m K- 



(10) 



In this expression g and x/ ; ^ = 1, ■ ■ ■ ,K are physical order parameters and are determined 
from the saddle-point equations. The numbers mi, I = 1,...,K are formally external ge- 
ometric parameters determining the replica-symmetry breaking scheme of the matrix \ ah 
from Eq. (ffi|). They parameterize successive scalings (replications) of extensive variables 
that would not change thermodynamically homogeneous solutions. 

It is evident that the averaged free energy density (jlOj) can be uniquely analytically con- 
tinued to arbitrary nonnegative numbers mi, . . . , = v, since it is represented by analytic 
functions for all nonnegative variables mi, I — 1, ... ,K. In the analytically continued func- 
tion, the geometric parameters mi need no longer be integers and either they need not form 
an ascending sequence. 

To find out whether a specific choice of geometric parameters m; can lead to a ther- 
modynamically homogeneous solution we have to understand how the free energy depends 
on these parameters. We obtain from the structure of the r.h.s. of Eq. (fTU|) the following 
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identities 



{x}; {m, = m K -i}) = fa-ifa {x}; M) 



(11a) 



{x}; W, rn K = 0}) = + xk, {x; Xi = Xi - Xk}] {m}) 



(lib) 



fie(q, {X, Xi = Xi+i}; {m}) = {x}; 0™})- 



(11c) 



The solutions in the first and third cases are degenerate. The averaged free energy density 
fx does not depend on xk in Eq. (jllaj) and it is independent of mi in Eq. picjl . Further 
on, if mif > Tn>K-i then fx < /x-i- We hence can conclude that if fx does depend on 
mjf, i. e., it is inhomogeneous, the averaged free energy displays a local maximum for some 
value rriK G (0, msr-i). Free energy fx;{q, {x}i { m }) is independent of v — rnx if and only 



That is, we can find such a parameter mx at which the averaged free energy density 
fi<{(l, {x}j { m }) reaches a local saddle point for the given values of mi, . . . ,mx-i with re- 
spect to variations of the parameter mx- Consequently, we can add the geometric parameters 
characterizing the structure of the phase space to the variational parameters. If the solution 
does not obey the global homogeneity condition dfx(q, {x}; {m}) / dm K = 0, the local ho- 
mogeneity condition dfx(q, {fn})/dmx = then minimizes deviations from the global 
thermodynamic homogeneity. It immediately follows from Eqs. (II lj) that this stationarity 
point is a local maximum. We fix in this way any new geometric parameter emerging in the 
hierarchical construction and achieve a theory with a thermodynamically determined ul- 
trametric structure. Notice, that both sets of parameters Xii ■ ■ ■ j Xk and mi, . . . , mx form 
sequences of decreasing numbers from interval [0, 1]. It is easy to verify that a substitution 

q ab = g + x ab in Eq _ (JJ7JJ) 

recovers 

B. Hierarchical stationarity equations 

To simplify the analysis of properties of the hierarchical free energy and the stationarity 
equations determining the variational parameters xi an d mi we rewrite the r.h.s. of Eq. (jlOjl 
in a recursive way. We define a sequence of partition functions 



if X K = 0. 




(12) 
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with the initial condition Zn = cosh 



. We denoted 



P{h + vVv + Eli *iV%Xi + a V^x 

A-Xi = Xi — Xi+i an d A% = Xk+i = X ~ J2b=i A%/- We singled out the scaling parameter 
v from the other geometric parameters. The averaged free energy density can then alterna- 
tively be represented as 



X, Axi, • • • , A Xk ; mi, ... , m K ) 



(l-g-x) 2 + 



+ 







K 



l-l 



1 



^isA X (2g + Ax)-^ln2 

l/v 



T>r] In 



VX Z V K 



(13) 



^miAxi 2(g + x - Ax 4 ) - Ax; 

i=l L i=l 

with g, x,Ax«,^ = 1, ...,K and m^,Z = 1, ...,iT as order parameters to be determined 
from stationarity equations. The number of hierarchies K used in the free energy should be 
chosen so that does not depend on the scaling parameter v. 

To represent the mean-field equations we introduce a set of hierarchical density matrices 
in the space of fluctuating random fields A/. We define pi(r), X; Xk, ■ ■ ■ , Xi) = Z™ 1 / (Z™ l ) x 



and p(r),X) = Z U /(Z U ) X with Z 



tations t 



tanh 



/ r7in K \l/mK 
\ Z K )x K ■ 



We further introduce short-hand no- 
and (t)i(r],X;X K ,...,Xi +1 ) = 



(pi... (pit) Xl . . with (X(A0)a ! = IZo VX i x ( x i)- 

With the above definitions we can write down the stationarity equations for the physical 
order parameters 

q(u,K) = ((p(t) K )l) ri 
x(v,K) = ((p(t 2 } K } x } v -((p(t} K )l} v 
A Xl (v,K) = - ((p((t)f)K)x) v 

and for the geometric ones 

4 ((p(lnZ i _i) i ,) A ),-((p(ln^) x ) A )^ 



(14a) 
(14b) 
(14c) 



m/(z/, K) 



P 2 ((p((t)li)Kh)l-((p((t)!)K)x); 



(15) 



where index I = 1, . . . , K. A thermodynamically homogeneous solution is obtained if X 



EnLi Ax; and the remaining 2K + 1 order parameters do not depend on 



v. 



C. Stability conditions 

Averaged free-energy density (fT3*|) defines a solution of the SK model with K hierarchical 
levels labeled by a scaling parameter v. A globally thermodynamically homogeneous aver- 
aged free energy may not depend on v. This happens if X — Ea=\ ^Xi- This condition of 

14 



global thermodynamic homogeneity is satisfied if an inequality 



l>/3 2 l-i' + ^ftrffl 




1=1 




K I r\ 



(16a) 



is fulfilled. This inequality, however, does not represent the only stability condition for a 
multilevel hierarchical free energy. A hierarchical solution with K levels is stable if it does 
not decay into a solution with K + 1 hierarchies. A new order parameter Ax may emerge 
so that Axi > Ax > Axi+i for arbitrary I. That is, the new order parameter peels off 
from Axi and shifts the numeration of the order parameters for i > I in the existing i^-level 
solution. To guarantee that this does not happen and that the averaged free energy depends 
on no more geometric parameters than mi , . . . , txik we have to fulfill a set of K generalized 
AT stability criterions that for our hierarchical solution read for / = 1, 2, . . . ,K — 1 



There is also a condition that the new order parameter emerges as the largest difference, 
that is A% > Axi- So that neither this instability takes place we have to fulfill 



Actually, it is sufficient to take into account only a single stability condition, namely that 
with the maximal right-hand side of Eqs. (|16|). Which of these right-hand sides is maximal 
depends on the particular choice of the optimal geometric parameters mi, . . . ,rriK mini- 
mizing thermodynamic inhomogeneity of the hierarchical solution with lower numbers of 
hierarchical levels. 

D. Physical interpretation of the order parameters from the hierarchical free en- 
ergy 

The hierarchical free energy, Eq. (|13|) . is equivalent to the Parisi discrete RSB solution 
with K hierarchies. Hence the resulting stationarity equations, Eqs. (114)) and (|15|) . coincide 
with the stationarity equations derived from the i^-step RSB free energy when we make 
a substitution q ab = q + x at '• The derived numbers must be the same. The meaning and 
a physical interpretation of the order parameters in both approaches may, however, be 




(16b) 




(16c) 
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different. Different interpretations of the role of the order parameters, in particular of 
the geometric ones, originate from the way the hierarchical free energy (JT5j) was derived. 
The RSB free energy was derived in an effort to maximize the averaged free energy within 
the replica trick and the discrete scheme (|13|) was used as an intermediate step toward its 
eventual form - the limit K — > oo and continuously distributed order parameters q(x), 
x G [0,1]. The physical interpretation of the Parisi RSB solution is then based on this 
continuous limit. 4] The present approach does not provide justification for the continuous 
limit and the physical meaning of the order parameters in the hierarchical free energy must 
be sought within the discrete scheme. 

The hierarchical free energy was derived by replica-symmetric averaging of the TAP free 
energy extended to a replicated phase space. Real replicas in the thermodynamic TAP 
approach were introduced to include control over thermodynamic homogeneity. Thermody- 
namic homogeneity is tightly connected with uniqueness of equilibrium states determined 
by mean-field local magnetizations calculated from the TAP equations. The TAP equations 
define a unique thermodynamic state if the solution reacts to all possible perturbations iden- 
tically and no possible internal structure of the solution can be revealed. We showed that 
by replicating the phase space we indeed reveal an internal structure of the TAP solutions. 

It is clear from the construction itself that the overlap susceptibilities x ab measure the 
interaction strength with which different copies of spins thermodynamically influence each 
other. That is, the thermal averaging of one spin copy depends on the values of spins 
in the other copies if x ab > 0. We cannot separate individual replicas although only one 
spin replica represents the physical system under consideration. The non-replicated original 
phase variables together with temperature and the chemical potential are hence insufficient 
to describe entirely the equilibrium thermodynamic states. To get rid of the dependence 
of thermodynamic states on boundary or initial conditions we have to average over all 
initial/boundary values and external variables that influence the thermodynamics of the 
investigated system. In long-range, completely connected models the degeneracy in solutions 
of the mean-field equations is reflected in the dependence on the initial spin configurations. 
We simulated this dependence in our approach with replicas of the spin variables subject to 
the same thermal equilibration. 

If a mean-field solution is thermodynamically inhomogeneous, thermal equilibration de- 
pends on the initial spin configuration. Dependence of the thermodynamic state on the 
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initial spin configuration from which we start equilibration may have a nontrivial form. It 
is reflected in our approach in the matrix \ ah . The replica-symmetric ansatz, \ ah = Xi 
means that all the initial spin configurations are equivalent and that there is only a sin- 
gle "mean" strength with which they affect the resulting equilibrium state. The replica 
symmetric ansatz is the most natural first guess motivated by the high-temperature phase 
but need not lead to a thermodynamically homogeneous solution. The dependence of the 
equilibrium states on their initial configurations should be chosen so as to reach a globally 
homogeneous solution. To achieve this goal we apply successive replications using only the 
simplest, replica-symmetric ansatz from the high-temperature solution at each stage. This 
construction seems to be more transparent than an unjustified replica symmetry-breaking 
ansatz. Moreover, the iterative construction offers an appealing physical interpretation of 
the geometric order parameters used in the hierarchical solution (|13j). 

To understand the role of the geometric parameters let us first take the 1RSB free en- 
ergy (|7ji . The interacting part of the averaged TAP free energy density reads 

N 

(17) 

We can see that the replicated spins influence the original spins by making the internal 
magnetic field dynamically random. The replicated free energy then behaves as if effectively 
vN spins of the original system enclosed in the volume vV were affected by the replicated 
spins outside the system under consideration. The internal magnetic field changes due to the 
existence of replicated spins to h — > h + \^/x~. The integral over the fluctuating variable A 
stands for averaging over the replicated (external) spins. The averaging over the replicated 
spins is dynamical (annealed), in contrast to the quenched (static) averaging over the random 
configurations of the spin exchange. The parameter v is then kind of a chemical potential 
governing the exchange between the active and additional replicated spin configurations. It 
has to be chosen so as the external replicated spins minimally influence the final equilibrium 
state of our original system. 

Adding more geometric order parameters with 1 > m\ > . . . > tjik > in the full 
hierarchical free energy means that the true equilibrium states are hierarchically dependent 
on the initial spin configurations or they depend on the history of quasi-equilibrium states 
they went through during thermal averaging. When the thermodynamic equilibrium of 
the original system depends on configurations of replicated spins we have to include the 
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N 



lnZ„(/3, h) 



In 



J vxz (f3,h + x^y 



replicated spins into our global thermodynamic system. In this merge we compose the total 
number of N spins from m\N from the original system and (1 — m{)N from the replicated 
one. The parameter mi is to be chosen so as to minimize the impact of the replicated spins 
on the original ones. Only the original spins, however, represent active variables, while the 
replicated ones form kind of a thermal bath. We have to iclude the bath explicitly into 
thermal equilibration of the active spin variables, since the latter are affected by the former. 
The bath spins affect the thermodynamics of the active spins via the overlap susceptibility 
Xi modifying their internal magnetic field. We further replicate the N spin variables in 
the whole volume and test whether our m\N active spins interacting with the bath with 
the overlap susceptibility Xi are affected by this replication. If yes, we have to include the 
new replicated spins into thermal averaging. We denote Xi the strength with which the 
new (second level) replicas affect the internal magnetic field of the active spins. The bath 
spins (first level replicas) are then affected by the new spin replicas in the same way as 
the first-level replicas act on the active spins, that is via an overlap susceptibility xi > X2- 
The optimal restructuring of spins in the whole system is such that only rri2N spins belong 
to the active ones, m\N are from the first-level bath and the rest of (1 — mx)N spins are 
the new replicated spins, second-level bath. The parameters m,\ and m 2 are dynamically 
determined from minimization of the impact of the newly replicated spins on the active ones. 
We continue with wrapping the active spin variables in successively replicated ones so long 
until we reach independence of the active spins on phase-space replications. The hierarchical 
construction converges toward a globally homogeneous solution if xi- > Xi > ■ ■ ■ > Xk — ► 0, 
or xk+i = at a finite number of hierarchies K. 

Alternatively we can interpret the free energy (|T3j) as a solution with a multitude of 
equivalent equilibrium thermodynamic states. Each state extends on average over a portion 
m^N of the whole spin space. The states are organized hierarchically with on average 
{mK-i — TriK) /ttik nearest neighbors with the overlap susceptibility xi, ( m K-2 — ^iK-i) /ttik 
next nearest neighbors with the overlap susceptibility X2 and so on. The last Kth level is 
characterized by (1 — mi)/m^ neighbors with the overlap susceptibility xk- The total 
number of equilibrium states then statistically is It is clear that pure states cannot 

be singled out and separated from their neighbors. Only the whole complex of hierarchically 
arranged states can be thermodynamically homogeneous and form an independent system 
with a well defined thermodynamic limit. 
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IV. CONCLUSIONS 



We used the basic physical principle of thermodynamic homogeneity and derived with 
the aid of real replicas in the thermodynamic TAP approach a hierarchical representation 
for the averaged free energy of the SK model. The hierarchical free energy (J 13)) was derived 
via successive replications of the phase space with the replica symmetric ansatz for the 
introduced order parameters - overlap susceptibilities. Real replicas proved to be a suitable 
tool for treating situations when the TAP order parameters, local magnetizations, do not 
describe unique thermodynamic states. Real replicas enable one to lift the degeneracy of 
the TAP approach and provide for a larger phase space within which a thermodynamically 
homogeneous solution can be found. The replica symmetric ansatz reflects an assumption 
of no internal structure (metric) of the thermodynamic states corresponding to a given set 
of local magnetizations from the TAP equations. This is the most natural (minimal) choice 
when we do not know the actual structure and organization of equilibrium states. Successive 
scalings in the phase space and the property of global thermodynamic homogeneity then lead 
to a selection of a nontrivial, ultrametric structure of thermodynamic states. We apply so 
many scalings of extensive variables (hierarchical levels) until the global thermodynamic 
homogeneity is achieved. 

The averaged free energy (JT5)l derived in this way is equivalent to the Parisi discrete 
RSB solution. It contains a set of averaged physical parameters q, xi, I = 1, . . . ,K and 
a set of geometric parameters mi, I = 1, . . . , K. The geometric parameters are turned 
variational ones by the demand of local thermodynamic homogeneity at each step of the 
hierarchical construction. The principle of local thermodynamic homogeneity replaces the 
maximum principle in the Parisi RSB construction. The homogeneity is reached successively 
by demanding stability with respect to scalings of extensive variables. Each hierarchical 
level then minimizes deviations from the global homogeneity and hence the instability of 
the solution. The maximum principle of Parisi emerges as a consequence of minimization 
of thermodynamic inhomogeneity of intermediate solutions and the form of stationarity 
equations for the SK model. However, it does not mean that the absolute maximum of 
the averaged free energy should be the equilibrium solution. The maximum principle holds 
only for thermodynamically inhomogeneous states. The free energy should still be minimal 
among thermodynamically homogeneous states. 
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We were able to derive the discrete Parisi RSB scheme from a physical principle of thermo- 
dynamic homogeneity but we do not find justification for its continuous version characterized 
by a nonlinear differential equation. The continuous version emerges in the limit K — > oo by 
assuming infinitesimal smallness of the overlap susceptibilities, \i = K and infinitesimal 
differences in the geometric parameters m;/m^ +1 = 1 + Si/K. In the continuous limit of the 
RSB scheme the geometric parameters are no longer determined thermodynamically, they 
cover interval [0, 1]. Only an order-parameter function q(x) for x G [0, 1] is to be determined 
variationally. In the discrete scheme the geometric order parameters form a discrete set and 
are determined thermodynamically from Eqs. ()15j) . These equations are essential part of 
the hierarchical solution and are of particular importance at low temperatures. Only with 
thermodynamically determined geometric parameters we are able to improve upon the SK 
free energy at zero temperature. At low temperatures, new variational parameters xi = /3mi 
are to be introduced and used instead of m^. Moreover, the thermodynamically shaped 
ultrametric structure of equilibrium states in the discrete scheme leads to tangible nonlinear 
effects. They go lost in the continuous limit. To decide whether the discrete or continuous 
versions of the Parisi solution with K = oo holds in the SK model, one has to evaluate the 
discrete scheme near the spin-glass transition point, which has not yet been done. Work on 
comparison discrete and continuous versions of the RSB near the critical temperature is in 
progress. 

Thermodynamic inhomogeneity of the SK solution in the real-replica approach was at- 
tributed to ambiguity of solutions of the TAP equations in the determination of pure equi- 
librium states. Although real replicas offer a way how to identify this degeneracy, they do 
not allow for separation of individual pure states. That is why an organization of ther- 
modynamic states cannot be determined without an ansatz. We hence cannot find a fully 
ansatz-free solution of the SK model. Successive scaling transformations with the replica 
symmetric ansatz allow the system to arrange equilibrium states so that thermodynamic in- 
homogeneity at intermediate states is minimal. It recovers the Parisi discrete RSB scheme, 
but we cannot claim that this is the only thermodynamically homogeneous solution. At 
present, we cannot even prove that the full (infinite level) solution is indeed thermodynam- 
ically homogeneous, that is, it fulfills stability conditions (fTEJ). Nevertheless, the proposed 
construction seems to offer a rather straightforward way based on basic principles of statisti- 
cal mechanics to reach the discrete RSB solution with stability conditions and an appealing 
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physical interpretation. 

To conclude, we demonstrated that the discrete RSB solution of the SK model is not 
a consequence of the replica trick and the limit of the number of replicas to zero. Using 
real replicas we showed that the averaged free energy is an analytic function of the number 
of replicas on the positive axis. The thermodynamically formed ultrametric hierarchical 
structure with K levels of the order parameters in the SK model was shown to emerge 
due to thermodynamic inhomogeneity of the replica symmetric solutions with less than 
K hierarchies. Thermodynamic homogeneity of the averaged free energy with respect to 
scalings (replications) of the phase volume is imposed at each hierarchical level. When 
not fulfilled, the free energy depends on the geometric scaling factor that is then chosen in 
order to minimize the inhomogeneity. It appears that in the SK model this minimization 
leads to maximization of the free energy. The number of hierarchical levels needed in this 
construction is fixed by the global homogeneity condition, Eq. (|16a|) . 
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Agency of the Academy of Sciences of the Czech Republic and the ESF Programme SPHINX. 
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